Nonequilibrium Work Relation in Macroscopic System 
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We reconsider a well-known relationship between the fluctuation theorem and the second law 
of thermodynamics by evaluating a probability measure-valued process. In order to establish a 
bridge between microscopic and macroscopic behaviors, we consider the thermodynamic limit of a 
stochastic dynamical system following the fundamental procedure often used in statistical mechanics. 
The thermodynamic path characterizing a macroscopic dynamical behavior can be formulated as 
an infimum of the action functional for the probability measure-valued process. In our formulation, 
the second law of thermodynamics can be derived by symmetry of the action functional, which is 
generated from the fluctuation theorem. We find that our formulation not only confirms that the 
ordinary Jarzynski equality in the thermodynamic limit can be rederived, but also enables us to 
establish a nontrivial nonequilibrium work relation for metastable states. 



Introduction- The Jarzynski equality (e ^'^)^^ = 
g-/3A<i>eq^ where A$eq is a free-energy difference, plays 
a role as a bridge between the symmetry of microscopic 
dynamics, the fluctuation theorem, and the fundamental 
limitation on time evolution of macroscopic quantities, 
the second law of thermodynamics [lH3. We usually 
term the Jarzynski equality as generalization of the sec- 
ond law of thermodynamics from the fact that Jensen's 
inequality for the Jarzynski equality yields its form as 
(W^)cq — A'J'oq- The present study does not aim at giv- 
ing any objection against the validity of the Jarzynski 
equality. However, we would like to ask the following fun- 
damental question on the above ordinary understanding 
on the relationship between the Jarzynski equality and 
the second law of thermodynamics. Does {W)^^ express 
the performed work in thermodynamics? 

The reasons for this question are as follows. Let us go 
back to a starting point of statistical physics and its con- 
nection with thermodynamics. To elucidate macroscopic 
properties from a microscopic description of the system, 
we consider an infinite-number limit of the sample mean, 
which is a coarse-grained picture of the system. On the 
other hand, the performed work given in the Jarzynski 
equality (W)^^ has not been baptized yet through this 
ordinary procedure. In terms of statistical mechanics, 
expectations coincide a global minimum of the rate func- 
tion, which describes the observed value in the thermody- 
namic limit. More precisely, the performed work written 
in the ordinary Jarzynski equality is not yet expressed 
by the global minimum of the rate function. In addition, 
the rate function can possess not only the global mini- 
mum but also several local minima, which represents the 
existence of so-called metastable states. Such a system 
does not always relax to equilibrium state within a time 
scale in a practical experience. From the above consid- 
erations, we cannot readily regard the performed work 



(^)oq Jarzynski equality as that in the macro- 

scopic system. This problem motivates us to compute the 
performed work in the thermodynamic limit by directly 
evaluating the dynamics for the coarse-grained quantity, 
which can be described by a probability measure-valued 
process [5|]- 

We analyze the probability measure- valued process in 
the following strategy. At first, we evaluate the entropy 
production of the system from the action functional @,0] , 
the rate function for the probability measure- valued pro- 
cess, which describes contributions around the represen- 
tative path of the time evolution in the thermodynamic 
limit. The second law of thermodynamics can be red- 
erived from the symmetry of this action functional, which 
is generated from the fluctuation theorem. This formula- 
tion is written in terms of the rate function, which is dif- 
ferent from the ordinary derivation through the Jarzynski 
equality as introduced above. This is one of our main re- 
sults in the present study. These analyses provide deep 
understanding on the connection between the fluctua- 
tion theorem and the second law of thermodynamics and 
bring us another nontrivial result. Owing to the analysis 
aiming at the thermodynamic limit, the symmetry of the 
action functional can reveal the form of the rate function 
for metastable states. This form enables us to establish 
a nontrivial nonequilibrium work relation for metastable 
states. The resulting work relation can be expressed in 
the same useful form as the Jarzynski equality in the 
limited cases with appropriate protocols related with re- 
laxation processes toward the selected metastable state. 

^^-Nfiwy ^ g-Ar/^{0e<,(/3,AT)-0,(/3,Ao)}^ 

where N is the number of components in the system we 
deal with, w is the performed work per component, and 
(/icq is the free energy per component for the last equilib- 
rium state while 4>i is that for the initial metastable state 
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distinguished by an index i. By use of our nonequilib- 
rium work relation, we can compute the free energy for 
the metastable state due to the same form as the Jarzyn- 
ski equahty. The existence of the metastable state is 
considered to be related with peculiar relaxation dynam- 
ics as in the glassy systems. Our result would provide a 
significant insight for understanding the special behavior 
observed in such complicated systems. In the remains of 
the paper, we describe our analysis in detail. 

Action functional for mean-field dynamics- Let us 
consider that the system consists of N components 
{Xi} [i — 1- ■ ■ N) and is attached to heat bath with an 
inverse temperature /3. The work is performed into the 
system by controlling external parameter A. Let us make 
two additional assumptions for the system in our study. 
First, the dynamics is described by Ito stochastic process, 
which satisfies the fluctuation theorem, as 



dxi 



d 

-t;—Hn {{xi} ,Xt) 



dt 



(2) 



where denotes the Wiener process, and H {{xi] ,X) 
is the Hamiltonian of the system 0, @]. Second, the 
Hamiltonian is represented as two-body interactions with 
all the components (i.e. mean field), 

({xj , A) = - 5] F;, (x.) - ^ ^ G (x„ X,) , (3) 



where F\ stands for the potential trap, G is the two- 
body interaction and symmetric G{x,y) — G{y,x). In 
this dynamical system, we analyze probability measure- 
valued process, which is the time evolution of the empir- 
ical measure as ^ {x,t) = (l/N) T,iS [xi — x) [sl. IgI. IqI. Iio| . 
It is straightforward to obtain 



5ix {x,t) = D^^^xt {x) dt+j^^Yl 



85 {xi — x) 
dxi 



d^^, (4) 



where Probt[fj] is the probability for the empirical mea- 
sure and (x, y) denotes a metric of the probability 
measure- valued process as 

„ , , 2 f , 86 (x — z ) 85 (y ~ z ) , , 
R,ix,y)^-Jdz^^^^,iz). (7) 

In order to elucidate the macroscopic behavior of the 
system, let us consider the thermodynamic limit (A^ 
oo) on Eq. Q. We reach a nonlinear diffusion equa- 
tion for the empirical measure fi{x,t), which represents 
thermodynamic time evolution of the system. 



dfj, {x, t) 
dt 



(8) 



Next, in order to examine the fluctuation from the so- 
lution of Eq. ([S]) in a sufficient large N, we analyze the 
conditional path probability for the stochastic dynamics 
govened by the functional Fokker-Planck equation Eq. 
([6]). We denote the conditional path probability during 
the time interval [0,r] as Path[X, fi\fio] = e~^■^^'>■■^^^^'^'l 
Here, J[o.t] [X, /i] is called the action functional given as. 



J[0,T] i^; lA 



(9) 



The La g r ang ian [jit, /it] is obtained by using Eq. ^ 

as 0,[iil[ii 



X {i^{y,t) - D^,,^x,{y)}dxdy. (10) 



We find a useful identity from the property on the inverse 
metric as J daR^^ {x, a) R^^ (a, y) = 5 {x — y), 



fi{x,t) 



8R-^ix,y)\ _ p 



8x 



5{x-y). (11) 



where 
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Df,,,x, (2:) = {f\t {x) /i (x, t)} 

8 { , s f , s , s,l 1 d'^fi(x,t) 
|m (-, t) J g {X, y) ^ {y, t) dy^ + -^^^ ■ 

(5) 

Here we use fxt {x) — 8Fxt [x) /8x and g (x, y) — 
8G{x,y) /8x. From Eq. (|4]), we derive the functional 
Fokker-Planck equation as 



d_ 
dt 



rfa;^^ {-^,.,A, (x) Proh [^A} 



By use of this identity, we can reveal the symmetry of 
the action functional according to the fluctuation theo- 
rem given by the ratio of the time forward path probabil- 
ity written by Lxt [/it, /it] and the time backward one by 



L-x 
gives 



Mt : A^t 



, where fif = fit, i = T — t. The ratio indeed 



(6) 



-2 J J dxdyR-l {x, y) D^,^^x, (x) fit (y) . (12) 

By using the identity Eq. ([Tl]) . the second term in Eq. 

([T^ is evaluated as J dx{5Icq,Xt[t^t] /5fJ.t{x)} flt{x). 

Here, we employ the rate function Icq.x [fj] for the canon- 
ical distribution exp{—/3Hj^)/ZN with the external pa- 
rameter A, where is the partition function. This rate 
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function is given as Icq, a [m] = /^ca M -s N -/^^cq (/3, A), 
where e^, s and 0eq represent the energy per component, 
the same form as the Shannon entropy and the free en- 
ergy per component, respectively 12|. By substituting 
Eq. into Eq. (0), we find that the symmetry of 

action functional J[o,t] [A, m] can be written as 



/cq,Ao [^J'0] + J[0,T] [\^A + I3W[Q^T] [\ lA 
= W\o [Ao] + J[o,T] [\f^ 
+/3{</.eq (/3,AT)-0eq(/3,Ao)}, 



(13) 



where i«[o,t] denotes the actual work per component per- 
formed by the external protocol A during the time inter- 

■ 

val [0,T] as W[Q^T][^,^A = / dt\tde\^[^it] / dXt- This 

Jo 

symmetry stands for the fluctuation theorem described 
by the action functional and allows us to formulate the 
second law of thermodynamics in terms of the work as 
usually used in thermodynamics. 

The second law of thermodynamics- Now we are in 
the position to end the discussion on the second law 
of thermodynamics starting from the coarse-grained pic- 
ture of the system. In terms of the action functional, 
the thermodynamic path which denotes a solution of 
Eq. ([5]), must satisfy J[o.t] [A,M*] = inf ^^[o.t] [A,m]7 

J[o,T] [A, /^*] ~ 0. Since the second law of thermodynam- 
ics is written in the inequality form, which connects the 
performed work and the free-energy difference between 
two different equilibrium states, we choose the initial con- 
dition of Eq. ([8]) as the equilibrium state /^oq,Ao i which 
holds /cq,Ao [Mcq.Ao] = 0- Thus, the thermodynamic path 
/i* [A; //cq,Ao] launched from the equilibrium state satisfies 



4q,Ao [Mcq.Ao] + J[ 



[A,/.*[A;/ieq,Ao]] =0. (14) 



[0,T] 



Substituting Eq. (|T4l) into Eq. (|T3l), we obtain 



/5w[o,T] [A,M* [A;/icq,Ao]] 

= 4q,Ao [/^O [A;/^oq,Ao]] + J[Q,T] 
+/3{</.eq (/?,AT)-0eq (/3,Ao)} 



A, (j* [A; Mcq.Ao] 



(15) 



where fx* [\\^c(i,\o\ denotes the time-reversal thermody- 
namic path /i* [A; Moq,Ao] ■, Ao [^'^ Mcq,Ao] is its initial con- 
dition and w [A, /i* [A; /icq,Ao]] stands for the work per- 
formed on the system which is termed in thermodynam- 
ics. 

Si'^'^e I^^ -^^ [AS [A;/ieq,Ao]] + J[0,T] A,/i* [A;/^eq,Ao] > 

0, we find the second law of thermodynamics 
W[Q.T\ [A, /i* [A; ^icc^,\o\] > '/'oq (/3, At) - (/-oq (/3, Aq). In ad- 
dition, the entropy production cr [A] can be written as 

W = ^ (4q,Ao [A(5 Meq,Ao]] + J[0,T] A, fl* [A; ^cq,Ao] 

(16) 

This relation implies the fluctuation dissipation rela- 
tion since the action functional describes the fluctuation 



around the thermodynamic path. Notice that, in our for- 
mulation, the second law of thermodynamics is derived 
without recourse to the Jarzynski equality. 

Before closing this section, we show the derivation of 
the ordinary Jarzynski equality from Eq. ([T^ . Suppose 
that the system is set in an initial equilibrium state. We 
can evaluate the expectation of the exponentiated work 



by employing Varadhan's theorem [12|, |13| and obtain 



(g-NfSwK ^ g-^Vinf^(-fcq,A(,[Mo]+J[o,Tl[A,M]+/3'i'[o,Tl[A,M]) 
\ /cq 

a7) 

Here, using Eq. (jl3p . we obtain the Jarzynski equality 



\ / cq 



(18) 



where A^^q (/i-cq At) 

™f (^q.Ao [Ao] + J[0,T] A, A 



(ficq (/?, Ao) and we use 
= 0. 

Nonequilibrium work relation for metastatic statcs- 
We give remarks on several properties of metastable 
states. First, we show how metastable states emerge 
in relaxation process. Suppose that the system is not 
perturbed during relaxation process. We choose the ex- 
ternal parameter A as constant c. The thermodynamic 
time evolution is given by the nonlinear diffusion equa- 
tion Eq. ([8]). Thus, metastable states and equilibrium 
state are given as fixed points of this equation. In or- 
der to obtain the fixed points of Eq. ([8]), we examine 
the Lyapunov function. We find that the rate function 
/oq,c [^A plays a roll of the Lyapunov function as 



/3 / dxfi {x, t) 



dlcq,c [fA 

dt 



'X \fcix)+ / g (x, y) fl {y, t) dy 



1 dlogfi {x,t) 
(3 dx 



< 0. 



(19) 



Thus the metastable states and equilibrium state are 
given as local minima and a global minimum of /cq.c [a*], 
respectively [see Fig[T]. Second, let us show the rate func- 
tion for metastable states. Suppose that the system has 
n metastable states. We then focus ith metastable state 
denoted by /Zi^c- The rate function for this metastable 
state can be represented as 0, 



V,.. 



inf 



Ji 



[0,< 



(20) 



where inf represents an infimum among all the 

paths /i launched from /i^^c to v during the time interval 
[0,oo]. To evaluate Eq. (|20|) . we employ the constant 
protocol version of Eq, p^ . 

^cq,c [Mo] + J[O^T] [/-*] = -^cq,c [Ao] + J[0,T\ [A] • 

Then, we obtain the rate function for the metastable 
state as @, [llj [see also FigH], 
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FIG. 1: (Color online) The blue curve represents the rate 
function for equilibrium state, /eq,c- The red dashed curve 
denotes the rate function for ith metastable state, Vi,c- The 
black circles represent the metastable states, while the white 
circle denote the equilibrium state. The black arrow repre- 
sents the downward parallel translation by /cq,c [m^.c] of the 
rate function /cq,c as the blue dashed curve. The white arrows 
describe the modification by Ai^c of the blue dashed curve into 
the red dashed curve Vi c. 



Vi^c W] — inf 



inf 



where Ai,c [i^] denotes a functional 



if in basin of Hi, 

positive others 



(21) 



(22) 



Notice that we do not need to reveal the explicit form of 
Ai^c [i^] to obtain the final result. 

Let us give a nontrivial nonequilibrium work relation 
for metastable states by use of the above functionals. 
Suppose that the system is initially set in ith metastable 
state, which differs from the initial condition of the or- 
dinary Jarzynski equality. The expectation of the expo- 
nentiated work is then evaluated as, by using the same 
procedure as the above case for the Jarzynski equality. 



By Eqs. ^ and ([21]), we reach 



xe 



(23) 



(24) 



where we use free energy per component of ith 



metastable state, (/3, A) = (1//3) /cq,A 



MZa 



Notice that the infimum in Eq. 



-0cq A) 

(121, 



A, jl 



[iIt] ) , cannot be al- 



of the ordinary Jarzynski equality. Taking into account 
the form of the functional Ai^c[v\ as in Eq. ((22)) . we 
find that the infimum can vanish without any additional 
information of the functional Ai^c [v\ when the time- 
reversal external protocol A expresses the protocol to- 
ward ith metastable state from the equilibrium state. 
Therefore we can obtain the nonequilibrium work relation 
for metastable states in the same form as the Jarzynski 
equality, which is Eq. ([l}. 

For the future study, we remark its realization in the 
actual experience in short. Suppose that we prepare a 
specific metastable state we are interested in by control- 
ling the protocol A from the initial equilibrium state. We 
use its inverse protocol in the actual experience. The 
system is driven from the selected metastable state by 
the inverse protocol. We compute the free energy for 
the metastable state by observation of the exponentiated 
work following Eq. ([1]) . The detailed observation of vio- 
lation of the equality by change from the inverse protocol 
would be significant, since the effect by choosing a differ- 
ent A comes from the remaining part of Eq. (j24p . 

Conclusion- We have provided deep understanding on 
the connection between the fluctuation theorem and the 
second law of thermodynamics, by rcderiving the latter 
from the symmetry of the action functional. In addi- 
tion, we have derived the nonequilibrium work relation 
for metastable states. As a result, this work relation can 
be expressed in the same form as the Jarzynski equality 
by limiting on the external protocol appropriately and en- 
ables us to compute the free energy for metastable states 
from the performed work. 
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